
United States Patent and Trademark Office 



UNITED STATES DEPARTMENT OF COMMERCE 
United States Patent and Trademark Office 
Address: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
www.uspto.gov 



APPLICATION NO. 


FILING DATE 


FIRST NAMED INVENTOR 


ATTORNEY DOCKET NO. 


CONFIRMATION NO. 


10/682,315 


10/09/2003 


Shan Liu 


SAM2.0031 


9834 



23386 7590 02/15/2007 

MYERS DAWES ANDRAS & SHERMAN, LLP 
19900 MACARTHUR BLVD., 
SUITE 1 150 
IRVINE, C A 92612 



EXAMINER 



RAO, AN AND SHASHIKANT 



ART UNIT 



PAPER NUMBER 



2621 



SHORTENED STATUTORY PERIOD OF RESPONSE 



MAIL DATE 



DELIVERY MODE 



3 MONTHS 



PAPER 



02/15/2007 

Please find below and/or attached an Office communication concerning this application or proceeding. 

If NO period for reply is specified above, the maximum statutory period will apply and will expire 6 MONTHS 
from the mailing date of this communication. 



PTOL-90A (Rev. 10/06) 



Office Action Summarv 


Application No. 

10/682,315 


Applicant(s) 

LIU ET AL. 


Examiner 

Andy S. Rao 


Art Unit 

2621 





The MAILING DATE of this communication appears on the cover sheet with the correspondence address 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) OR THIRTY (30) DAYS, 

WHICHEVER IS LONGER, FROM THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .1 36(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1.704(b). 

Status 

1 )□ Responsive to communication(s) filed on 26 October 2005 . 
2a)D This action is FINAL. 2b)KI This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) ^ Claim(s) 1-24 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) Q Claim(s) is/are allowed. 

6) E3 Claim(s) 1-24 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) D The specification is objected to by the Examiner. 

10) D The drawing(s) filed on is/are: a)D accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121 (d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

1 2) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 1 1 9(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2. D Certified copies of the priority documents have been received in Application No. . 

3. Q Copies of the certified copies of the priority documents have been received in this National Stage 

application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 



Attachment(s) 

1) ^ Notice of References Cited (PTO-892) 

2) Notice of Draftsperson's Patent Drawing Review (PTO-948) 

3) Information Disclosure Statement(s) (PTO/SB/08) 
Paper No(s)/Mail Date 10/26/05 . 

U.S. Patent and Trademark Office " ~ ~ ~~ 

PTOL-326 (Rev. 08-06) Office 



4) □ Interview Summary (PTO-413) 

Paper No(s)/Mail Date. . 

5) □ Notice of Informal Patent Application 

6) □ Other: . 



Summary Part of Paper No./Mail Date 2007021 3 



Application/Control Number: 1 0/682,3 1 5 Page 2 

Art Unit: 2621 

DETAILED ACTION 

Specification 

1 . The specification has not been checked to the extent necessary to determine the presence 
of all possible minor errors. Applicant's cooperation is requested in correcting any errors of 
which applicant may become aware in the specification. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent, may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

3. Claims 1-24 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pan et al;, 
(hereinafter referred to as "Pan") in view of Qi et al., (hereinafter referred to as "Qi"). 

Pan discloses a method of detecting fade in an area of each of a sequence of frames 
comprising pixels that represent digital video images (Pan: figures 4-5), comprising the steps of: 
calculating a stochastic measure of said area based on the differences in pixel values in at least 
two of said frames (Pan: paragraphs [0078]-[0082], all); and detecting fade in said area by 
comparing the stochastic measure with a given noise level (Pan: paragraph [0036], lines 20-30), 
such that if the difference between era and noise level is greater than a threshold value then fade 
is detected (Pan: paragraph [0040], lines 1-8), as in claim 1. However, Pan fails to disclose that 
the stochastic measure is based on a standard deviation computation as in the claim. Qi discloses 
a shot boundary detection method which relies upon standard deviation computations (Qi: 
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column 1, lines 35-45) as a detection method as opposed to the use of histogram computation as 
in the primary reference (Pan: paragraph [0087], lines 1-8) in order to account for the correct 
interpretation of light flashes in a image sequence (Qi: column 1, lines 45-51) particularly in 
sporting events (Qi: column 1, lines 55-60) such as those sequences as in the primary reference 
(Pan: paragraph [0036], lines 10-17). Accordingly, given this teaching, it would have been 
obvious for one of ordinary skill in the art to incorporate the Qi teaching of using standard 
deviation calculations for shot/transition detection into the Pan method in order to have the Pan 
method correctly account for light flashes in its logo detection method for sporting events. The 
Pan method, now incorporating the use of Qi's standard deviation calculations, has all of the 
features of claim 1. 

Regarding claim 2, the Pan method, now incorporating the use of Qi's standard deviation 
calculations, includes the steps of: (a) for each logo pixel in the current frame (Pan: paragraph 
[0080], lines 1-4): (i) determining the difference between the value of the current pixel and that 
of a corresponding pixel in a reference frame (Pan: paragraph [0078], lines 1-5), (ii) subtracting 
the given noise mean from the said difference and squaring the obtained value (Qi: column 11, 
lines 60-67; column 12, lines 1-3); and (iii)generating a sum of the squared differences with 
noise mean subtracted for each of a plurality of pixels within the logo area (Pan: paragraph 
[0042], lines 1-13); (b) generating an average of the sums, and determining the stochastic 
measure based on said average (Qi: column 12, lines 65-67; column 13, lines 1-4), as in the 
claim. 
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Regarding claims 3-4, the Pan method, now incorporating the use of Qi's standard 
deviation calculations, has the use of a standard deviation calculation (Qi: column 8, lines 25-60; 
column 13, lines 5-15), as in the claims. 

Regarding claims 5-6, the Pan method, now incorporating the use of Qi's standard 
deviation calculations, includes a sub-image; the method further includes the steps of initially 
detecting the area including the sub-image, and generating a map including a pixel pattern 
corresponding to the video frame, wherein each pixel in the pattern indicates whether the 
corresponding pixel in the video frame is in the sub-image (Pan: paragraph [0042], lines 1-13), 
as in the claims. 

Regarding claims 7-8, the Pan method, now incorporating the use of Qi's standard 
deviation calculations, has wherein the noise level is selected by determining a standard 
deviation of noise samples from the video signal (Qi: column 13, lines 5-15), wherein i is the 
index of a digital noise sample (Qi: column 12, lines 10-40), as in the claims. 

Pan discloses a method of detecting fade of a logo in a sequence of frames comprising 
pixels that represent digital video images (Pan: figures 4-5), comprising the steps of: for each 
logo pixel in the current frame (Pan: paragraph [0036], lines 17-25): determining the difference 
between the value of the current pixel and that of a corresponding pixel in a reference frame 
(Pan: paragraph [0081], lines 1-5); subtracting the given noise mean from the said difference and 
squaring the obtained value (Pan: paragraph [0076], lines 1-7); generating a sum of the squared 
differences with noise mean subtracted for each of a plurality of pixels within the logo area 
[0078], lines 1-5), generating an average of the sums (Pan: paragraph [0067], lines 1-8), as in 
claim 9. However, Pan fails to disclose comparing said average to a given noise level represented 
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by STD, such that if the difference between the average and the noise STD is greater than the 
threshold value then fade is detected, as in the claim. Qi discloses a shot boundary detection 
method which relies upon standard deviation computations (Qi: column 1, lines 35-45) as a 
detection method as opposed to the use of histogram computation as in the primary reference 
(Pan: paragraph [0087], lines 1-8) in order to account for the correct interpretation of light 
flashes in a image sequence (Qi: column 1 , lines 45-51) particularly in sporting events (Qi: 
column 1, lines 55-60) such as those sequences as in the primary reference (Pan: paragraph 
[0036], lines 10-17). Accordingly, given this teaching, it would have been obvious for one of 
ordinary skill in the art to incorporate the Qi teaching of using standard deviation calculations for 
shot/transition detection into the Pan method in order to have the Pan method correctly account 
for light flashes in its logo detection method for sporting events. The Pan method, now 
incorporating the use of Qi's standard deviation calculations, has all of the features of claim 9. 

Regarding claims 10-1 1, the Pan method, now incorporating the use of Qi's standard 
deviation calculations, has the initial steps of: detecting the logo in the video frame, and 
generating a map including a pixel pattern corresponding to the video frame, wherein each pixel 
in the pattern indicates whether the corresponding pixel in the video frame is in the logo (Pan: 
paragraphs [0042] and [0052], all) as in the claims. 

Regarding claims 12-13, the Pan method, now incorporating the use of Qi's standard 
deviation calculations, has wherein the noise level is selected by determining a standard 
deviation of noise samples from the video signal (Qi: column 13, lines 5-15), as in the claims. 

Pan discloses a fade detection system for detecting fade in a logo in a sequence of frames 
comprising pixels that represent digital video images (Pan: figure 27), comprising: a detector for 
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detecting the logo in a video frame (Pan: paragraph [0036], lines 17-25); a logo map generator 
generating a map including a pixel pattern corresponding to the video frame (Pan: paragraph 
[0077], lines 1-8), wherein each pixel in the pattern indicates whether the corresponding pixel in 
the video frame is in the logo (Pan: paragraph [0075], lines 1-8); a logo tracker that detects logo 
fade by: using the map to select pixels of the video frame that are in the logo to (Pan: paragraph 
[0071], lines 1-11), determine the difference between the value of the current pixel and that of a 
corresponding pixel in a reference frame (Pan: paragraph [0081], lines 1-5), subtracting the given 
noise mean from the said difference and squaring the obtained value (Pan: paragraph [0076], 
lines 1-7), and generating a sum of the squared differences with noise mean subtracted for each 
of a plurality of pixels within the logo area [0078], lines 1-5); generating an average of the sums 
(Pan: paragraph [0067], lines 1-8), as in claim 14. However, Pan fails to disclose comparing said 
average to a given noise level represented by STD, such that if the difference between the 
average and the noise STD is greater than the threshold value then fade is detected, as in the 
claim. Qi discloses a shot boundary detection apparatus (Qi: figure 2) which relies upon standard 
deviation computations (Qi: column 1, lines 35-45) as a detection means as opposed to the use of 
histogram computation means of the primary reference (Pan: paragraph [0087], lines 1-8) in 
order to account for the correct interpretation of light flashes in a image sequence (Qi: column 1, 
lines 45-51) particularly in sporting events (Qi: column 1, lines 55-60) such as those sequences 
as in the primary reference (Pan: paragraph [0036], lines 10-17). Accordingly, given this 
teaching, it would have been obvious for one of ordinary skill in the art to incorporate the Qi 
teaching of using standard deviation calculations for shot/transition detection into the Pan fade 
detection system in order to have the Pan system correctly account for light flashes in its logo 
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detection for sporting events. The Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, has all of the features of claim 14. 

Regarding claims 15-16, the Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, has wherein the noise level is selected by determining a 
standard deviation of noise samples from the video signal (Qi: column 13, lines 5-15), as in the 
claims. 

Pan discloses a fade detection system for detecting fade in a logo in a sequence of frames 
comprising pixels that represent digital video images (Pan: figure 27), comprising: a detector for 
detecting the logo in a video frame (Pan: paragraph [0036], lines 17-25); a logo tracker (Pan: 
paragraph [0071], lines 1-7) that calculates a stochastic measure of said area based on the 
differences in pixel values in at least two of said frames (Pan: paragraphs [0078]-[0082], all), and 
detects fade in said area by comparing the stochastic measure with a given noise level (Pan: 
paragraph [0036], lines 20-30), such that if the difference between era and noise level is greater 
than a threshold value then fade is detected (Pan: paragraph [0040], lines 1-8), as in claim 17. 
However, Pan fails to disclose that the stochastic measure is based on a standard deviation 
computation as in the claim. Qi discloses a shot boundary detection apparatus (Qi: figure 2) 
which relies upon standard deviation computations (Qi: column 1, lines 35-45) as a detection 
means as opposed to the use of histogram computation means of the primary reference (Pan: 
paragraph [0087], lines 1-8) in order to account for the correct interpretation of light flashes in a 
image sequence (Qi: column 1, lines 45-51) particularly in sporting events (Qi: column 1, lines 
55-60) such as those sequences as in the primary reference (Pan: paragraph [0036], lines 10-17). 
Accordingly, given this teaching, it would have been obvious for one of ordinary skill in the art 
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to incorporate the Qi teaching of using standard deviation calculations for shot/transition 
detection into the Pan fade detection system in order to correctly account for light flashes in its 
logo detection for sporting events. The Pan fade detection system, now incorporating the use of 
Qi's standard deviation calculation module, has all of the features of claim 17. 

Regarding claim 18, the Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, has the tracker calculate the stochastic measurement by: 
(a) for each logo pixel in the current frame (Pan: paragraph [0080], lines 1-4): (i) determining the 
difference between the value of the current pixel and that of a corresponding pixel in a reference 
frame (Pan: paragraph [0078], lines 1-5), (ii) subtracting the given noise mean from the said 
difference and squaring the obtained value (Qi: column 11, lines 60-67; column 12, lines 1-3); 
and (iii)generating a sum of the squared differences with noise mean subtracted for each of a 
plurality of pixels within the logo area (Pan: paragraph [0042], lines 1-13); (b) generating an 
average of the sums, and determining the stochastic measure based on said average (Qi: column 
12, lines 65-67; column 13, lines 1-4), as in the claim. 

Regarding claims 19-20, the Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, has the use of a standard deviation calculation (Qi: 
column 8, lines 25-60; column 13, lines 5-15), as in the claims. 

Regarding claims 21-22, the Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, includes a logo map generator for generating a map 
including a pixel pattern corresponding to the video frame, wherein each pixel in the pattern 
indicates whether the corresponding pixel in the video frame is in the sub-image (Pan: paragraph 
[0042], lines 1-13), as in the claims. 



Application/Control Number: 1 0/682,3 1 5 Page 9 

Art Unit: 2621 

Regarding claims 23-24, the Pan fade detection system, now incorporating the use of Qi's 
standard deviation calculation module, has the wherein the noise level is selected by determining 
a standard deviation of noise samples from the video signal (Qi: column 13, lines 5-15), wherein 
i is the index of a digital noise sample (Qi: column 12, lines 10-40), as in the claims. 

Conclusion 

4. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Dimitrova discloses an apparatus and method for locating a commercial disposed 
within a data stream. 

5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Andy S. Rao whose telephone number is (571)-272-7337. The 
examiner can normally be reached on Monday-Friday 8 hours. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on (571)-272-7418. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



Andy S. Rao 
Primary Examiner 
Art Unit 2621 
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